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DETAILED ACTION 
Response to Arguments 

Applicant's arguments, see Remarks pages 1-4, filed 25 May 2005, with respect 
to various rejections have been fully considered and are persuasive. 

The objection to claim 21 stands v>/lthdrawn since applicant amended the claim to 
correct the dependency issues. 

The rejections applied to claims 13-14 and 23-24 have been withdrawn because 
applicant canceled these claims. 

The rejection of claims 7-10 and 17-22 under 35 U.S.C. 103(a) stands withdrawn 
in view of applicant's amendments. 

New grounds of rejection follow below for claims 7-10, 17-22, and newly added 
claims 25-33, and are necessitated by applicant's amendments. 

Examiner notes that the changes and additions to each claim changes claim 
scope sufficiently to require a new search, thusly allowing any new combinations of 
references to be used. As such, the finality of this Office Action is proper. 

Applicant argues in Remarks page 2 that Haeberli does not specify that the 
weights be specified on a per-pixel basis and that Haeberli teaches away from this 
particular limitation. 

First of all, the fact that the weight used in Haeberli can be positive or negative 
does not teach away from using alpha as a weight. To the contrary, it simply means 
that the system of Haeberli has the flexibility to utilize other weighting schemes. 
Haeberli does however specify that each pixel possesses an alpha value, which clearly 
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does establish that Haeberii provides a per-pixel weight (namely, alpha) that could be 
utilized for such purposes. 

Claim Objections 

Applicant is advised that should claim 28 be found allowable, claim 29 will be 
objected to under 37 CFR 1 .75 as being a substantial duplicate thereof. When two 
claims in an application are duplicates or else are so close in content that they both 
cover the same thing, despite a slight difference In wording, it is proper after allowing 
one claim to object to the other as being a substantial duplicate of the allowed claim. 
See MPEP § 706.03(k). 

Claim Cancellations 
Claims 1-6, 1 1-16, and 23-24 are cancelled by applicant, with claims 25-33 
having been added by the amendment of 25 May 2005. 

Claim Rejections • 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if ttie differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to vy^ich said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 

USPQ 459 (1966), that are applied for establishing a background for determining 

obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 
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4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claims 7-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Morein in view of Haeberli and Cesana et al (US 6,466,220 B1 ). 

In regards to claim 7, Morein and Haeberli in combination clearly teach a method 
comprising: (a) reading a first stream of image pixels corresponding to an image 
Xk from an image memory; (b) reading a second stream of pixels corresponding 
to an image Ak from an accumulation buffer; (c) blending each image pixel of the 
image Xk with the corresponding pixel of the image Ak based on an alpha value 
provided with the image pixel, and thus, generating a third stream of output 
pixels defining an image Ak^i; and (d) transferring the third stream of output 
pixels to the accumulation buffer; (e) performing (a), (b), (c), and (d) for each 
image after the first image of a sequence of N images Xk for K=0, 1, 2, ... N-1. 

• Morein teaches a method and apparatus for supporting accumulation 
buffering in a video graphics system (Col. 2, lines 3-36), which explicitly is 
accumulating each image in a sequence of images Xk, K=0, 1, 2, ... N-1. 
All video comprises a sequence of images. 

• Morein teaches blending together pixel data from the drawing buffer (140) 
and the first (170) or second accumulation buffer (180) using the controller 

, (160), which specifically is reading a first stream of image pixels and 
second stream of image pixels as recited in the instant claim (Col. 5, line 
10 - Col. 6, line 12 and FIG. 1). Thus, said drawing buffer specifically is an 
image buffer. The controller reads the pixel data from the drawing buffer 
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and adds said pixel data to the corresponding pixel data in the 
accumulation buffer based on the information found in the mask buffer 
(150). Said mask buffer allows the accumulation process to be performed 
efficiently by indicating only the relevant pixel data. In addition, Morein 
teaches that once a predetermined number of accumulation operations 
have occurred for a predetermined number of images, said first 
accumulation buffer acts as the output buffer (Col . 6, lines 13-25). Thus, 
said blended pixel data is transferred back and stored in the first 
accumulation buffer. Then the second accumulation buffer takes over the 
next predetermined set of accumulation processes. In other words, the 
first and second accumulation buffer takes turn accumulating pixel data for 
each sequence of image. 

• Although Morein does not explicitly teach blending images based on alpha 
values, it is well known and standard in the art that blending images using 
accumulation buffer requires alpha blending. Bleriding a plurality of layers 
specifically must be performed using not only the color values but also the 
alpha values. Said alpha values determine the weight given to each image 
in the set of images being blended together. 

• A buffer is clearly a type of memory by definition. While the terms are not 
absolutely interchangeable, a buffer is a type of memory. The word buffer 
in this context can be replaced by the word memory, and such substitution 
is a broadening amendment, thus warranting the final status of this 
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Office Action. Clearly, the buffers of Morein are memories and thus teach 
this limitation. 

• Obviously, when the system is initialized, the contents of all buffers and 
memories (at least image buffers and memories) will be set to null. The 
first image or stream would be stored in one buffer, but it would make no 
sense whatsoever to combine or blend it with a null or nonexistent image. 
Therefore, it would be obvious that only after the second image or stream 
had arrived that each image should be combined as set forth in the instant 
claim. 

It is well known in the art that frame buffers typically store data in an RGBA (red, 
green, blue, alpha format). An analogous art, Haeberii et al. teaches that the 
accumulation buffer provides 16 bits to store each red, green, blue, and alpha color 
components (Pages 31 1 , Section 3.2). Thus, by definition, blending the alpha color 
components of all images being blended specifically is blending based on the alpha 
value provided with each pixel. Haeberii is ONLY utilized to show that the accumulation 
buffer has RGB and alpha (A) channels. Note the discussion concerning the limitations 
of Haeberii in the Response to Arguments section above. 

An analogous art, Cesana teaches that alpha blending (Abstract, 2:49-60) pixel 
streams is well known in the art (5:5-10) and provides benefits such as allowing the 
addition of multiple region (on-screen display) graphics and the like (1:1 0-35). Alpha 
blending is obvious and well known in the art, as stated in the last Office Action. 
Cesana is added as proof of this statement. 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to take the teachings of Morein and to modify it by adding the method of 
blending each image pixel based on the alpha value of each image pixel in order to 
implement standard blending using the accumulation buffer. The alpha values dictate 
the opacity of each image pixel, which influence the weighed average of the color 
values for each pixel, and thus blending by alpha value is a necessary standard 
technique well known in the art as shown In Cesena, since this modification would allow 
the creation of multiple region graphics and provide many other useful capabilities to the 
system of Morein, which has accumulation buffers that prima facie possess alpha 
values on a per-pixel basis as specified in Haeberii (and accumulation buffers have 
been known to have alpha values on a per-pixel basis since Haeberii, well over twelve 
years before the filing of the instant application, and a decade before the filing of the 
Morein and Cesana application), since this allows the specification of quadruplet RGBA 
values for writing to the accumulation buffer, which is known to be more efficient, and 
for the reasons specified in the previous Office Action. 

In reference to claim 9, Morein, Haeberii, and Cesana teach the method of claim 
7 as described above. In addition, Morein and Haeberii et al. teach in combination said 
blending comprises blending red, green and blue components of each output pixel in 
parallel. 

As applied to claim 7 above, all color values are blended together for each pixel 
(Col. 5, line 26 - Col. 6, line 25). Since Haeberii et al. teaches that accumulation buffers 
provides storage for RGB and alpha color values, blending color values together as 
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taught by Morein specifically is blending RGB and alpha values together. And since all 
color values for each pixels are blended together, said blending of RGB and alpha 
values must be performed in parallel. 

In reference to claim 10, Morein, Haeberii, and Cesana teach the method of 
claim 7, but do not explicitly teach wherein (a), (b), (c), (d) and (e) are performed by a 
graphics hardware accelerator chip in response to software functions executed on a 
host processor. Although Morein and Haeberii et al. do not explicitly name a hardware 
accelerator, the prior art discloses the overall architecture of one embodiment where the 
system is implemented on a processor, a state machine, or other circuitry (Col. 5, lines 
26-30 and Col. 7, lines 6-16). Said graphics system comprising an integrated circuit 
specifically is a hardware accelerator chip performing in response some sort of software 
commands to perform (a), (b), (c), (d), and (e). Also, the instruction is given via software 
since that is the conventional method of communication between the processor and the 
rest of the graphics hardware. Thus, it would have been obvious to implement the 
graphics system of Morein and Haeberii et al. using a hardware accelerator chip. 

In regards to claim 17, the same basis and rationale for claim rejection as applied 
to claim 7 above. The limitations of claim 17 are identical to the limitations of claim 7, 
except for one added limitation directed to the mixing unit. Morein explicitly teaches a 
mixing unit (Col. 5, line 26 - Col. 6, line 25). Said controller (160) specifically is a mixing 
unit. 
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Claims 8, 18-19, and 22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Morein in view of Haeberii and Cesana, and further in view of 
McReynolds. 

In reference to claims 8 and 18, Morein, Haeberii, and Cesana teach the method 
of claim 7, but does not explicitly teach the color predsion of the accumulation buffer is 
greater than the color precision of the image buffer. It is well known and obvious, 
however, to implement a more precise output data calculation in order to avoid losing 
original data precision and minimize aliasing. An analogous art, McReynolds et al., 
teaches said limitations. 

• McReynolds et al. teaches that 'in order to maintain accuracy over many 
blending operations, the accumulation buffer has a higher number of bits 
per color components than a typical color buffer (section 6.4, lines 3-4). 
Higher number of bits per color components will result in greater color 
precision for the accumulation buffer. 
It would have been obvious to someone of ordinary skill in the art to take the 
teachings of Morein, Haeberii, and Cesana and to add from McReynolds, the method of 
providing higher color predsion of the accumulation buffer than the color precision of 
the image buffer in order to maintain color precision accuracy over many blending 
operations. This prevents loss of data and alleviates aliasing problems. It is always 
important to maintain precise accuracy of data after any data processing. 

In reference to claim 19, Morein, Haeberii, and Cesana teach the method and 
system of claim claims 7 and 17 above and Morein, Haeberii, and Cesana and 
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McReynolds teach the system of claims 8, 18, and 22 above. In addition, remember that 
Morein teaches a first and a second accumulator in order to minimize the delay between 
accumulation and rendering. Since each pixel provides a RGB color component and an 
alpha value, each of the plurality of accumulators is capable of mixing a corresponding 
color component. Morein also explicitly teaches that if the color data includes multiple 
color portions, such as red, green, and blue portions, each of these portions will be 
treated individually by the output block (Col. 6, lines 37-42), and thus it would have been 
obvious to one of ordinary skill in the art at the time of the invention to take the 
teachings of Morein and Haeberii and to implement a plurality of mixing units to 
accumulate individual color components. Since parallel processing is well known and 
obvious in the ad, it would have been obvious to use a plurality of mixing units to 
comprise the controller (160) of Morein. Haeberii et al further suggests this, since an 
accumulator buffer comprises 16 bit to store each red, green, blue, and alpha 
components, it would be wise to apply a different mixer for each component in order to 
perform parallel processing and speed up the overall image processing. 

In reference to claim 22, Morein, Haeberii, and Cesana teach the system of claim 
17, and Morein, Haeberii, Cesana, and McReynolds teach the system of claim 18 
above. While Morein, Haeberii, and Cesana do not explicitly teach the color precision of 
the accumulation buffer is at least AN larger than the color precision of the image buffer, 
wherein AN is the base two logarithm of the maximum number of images to be blended 
into the accumulation buffer, McReynolds et al. teaches said limitation in the following in 
similar fashion as applied to claims 8 and 18 above. 
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As applied to claims 8 and 18 above, McReynolds et al. teaches that in order to 
maintain accuracy over many blending operations, the accumulation buffer has a higher 
number of bits per color components than a typical color buffer (section 6.4, lines 3-4). 
Higher number of bits per color components than a typical color buffer is interpreting 
broadly as to include the bit range AN larger than the color precision of the image buffer. 
The definition of AN, base two log of maximum number of images to be blended into the 
accumulation buffer, is one of design choices resulting in the accumulation buffer having 
a higher number of bits per color than the image buffer. AN as defined by the applicant 
has no clear advantage over other design choices, and the specific definition still falls 
under the range of bit size disclosed by McReynolds. 

It would have been obvious to someone of the ordinary skill in the ad to take the 
teachings of Morein, Haeberii, and Cesana and to take firom McReynolds et al. and one 
of many design choices to modify the bit size of the accumulation buffer to be at least 
AN larger than that of the image buffer, where AN is defined as stated in the claim 
language, in order to maintain color precision accuracy over many blending operations. 
This is the same motivation as applied to claims 8 and 18 above. 

Claims 21 is rejected under 35 U.S.C. 103(a) as being unpatentable over Morein 
in view of Haeberii and Cesana, and further in view of McReynolds et al. as applied to 
claims 8, 18, and 22 above, and further in view of Murata et al. 

In regards to claim 21 , Morein, Haeberii, Cesana, and McReynolds et al. teach 
the system of claim 18 above, but do not explicitly teach wherein the image buffer 
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resides within the frame buffer of a graphic system. It is, however, well known in the art 
that frame buffer Is a memory module storing image information to be sent to the display 
device (e.g. Monitor), and it is also well known and standard in the art the a memory 
module can comprise a plurality of separate memory units. This allows for easy transfer 
of data from one memory to another, especially any image data from image buffer to 
frame buffer for the purpose of speedy display of said image data. For example, an 
analogous art, Murata et al. explicitly teaches that a frame buffer comprises an image 
buffer and a Z buffer (Col. 1, lines 33-40, Col. 3, lines 4-37 and FIG. 1(A), 3-4). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to take 
the teachings of Morein, Haeberii, Cesana, and McReynolds et al, and to add from 
Murata et al., the combined image and frame buffer since it is well known and obvious 
standard in the art. Having separate buffers in one memory (buffer) module saves 
space, speeds data transfer and provides overall efficient graphic system. 

Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Morein 
in view of Haeberii and Cesana, and further in view of McReynolds as applied to claims 
8, 18, and 22 above, and further in view of Murata et al. as applied to claim 21 above, 
and further in view of Takeuchi. 

In reference to claim 20, Morein, Haeberii, Cesana, and McReynolds teach the 
system of claim 18 above, but do not explicitly teach the accumulation buffer resides 
within a texture buffer of a graphics system. But, remember that Murata explicitly 
teaches that a plurality of buffers can reside in one large buffer unit. An analogous art. 
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Takeuchi, explicitly teaches one memory module comprising a plurality of buffers 
including an accumulation buffer (47) and a texture buffer (48) connected as one unit 
(FIG. 3). Since the accumulation buffer and the texture buffer are indeed connecting 
together in the figure, Takeuchi explicitly teaches an accumulation buffer residing within 
a texture buffer. In addition, in light of the well know and standard memory allocation 
technique as taught by Murata, it would have been obvious to one of ordinary skill in the 
ad at the time of the invention to take the teachings of Morein, Haeberii, Cesana, and 
McReynolds, and to add from Murata, and Takeuchi the memory allocation technique to 
combine a plurality of buffers in one large memory module in order to save space and 
speed up data transfer as applied to claim 21 above. This effectively eliminate the need 
for extra individual buffers and to expand the capacities of the texture buffer since a 
texture buffer can include several SDRAMS capable of housing several types of buffers 
and memories. Further, having the accumulation buffer reside in the texture buffer will 
reduce interconnect lengths and thus improve speed and efficiency of the hardware 
accelerator. 

Claim 25 is rejected under 35 U.S. C. 103(a) as obvious over Morein, Haeberii, 
and Cesana as applied to claim 17, and further in view of Adier et al (US 6,028,907). 

As to claim 25, this is essentially the same system as that of claim 1 7 with 
additional limitations, the rejection to which is incorporated by reference. Specifically, 
the mixing unit of the system of claim 17 is comparable to the accumulation unit of claim 
25. The limitation of processing N of the images is taught in the third clause. The "2D 
slice" of the instant claim is comparable to the Xku, image - that is, an image is 
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inherently 2D, and so such a slice would in fact meet that limitation. Also, the weighted 
value is not specified to be an alpha value, so in theory Morein alone would be sufficient 
to make the rejection, but the other references are included for the reasons discussed in 
the Response to Arguments section and the rejection to claim 17 itself. 

Specifically, Adier teaches in Figure 2 that a stack of 2D slices from a CT scan 
(which is known in the art to be generated by incrementally moving a patient through a 
fixed scanning apparatus to generate a stack of sequential two-dimensional images of a 
3D object) can be merged to generate a three-dimensional model of said object. AdIer 
further marks contours on each object (as is apparent in Figure 2)(4:35-55, for example) 
so that a composite view of the three-dimensional object can be generated and 
navigated around in three-dimensional space (6:10-16). 

Obviously, the system of Morein could be used to generate the resultant three- 
dimensional view, since AdIer does not specify that much of the specific graphics 
subsystem used to calculate such details. 

It would be obvious to one of ordinary skill in the art at the time the invention was 
made to combine the systems of Morein, Haeberii, and Cesana with the system of AdIer 
so that a system that could more rapidly render three-dimensional models of bone 
deformation for scoliosis and the like could be generated and efficiently navigated 
through by a user. 

As to claim 26, Haeberii and Cesana clearly teach the use of alpha values, and 
that each pixel has its own alpha value. It would be obvious that if images were being 
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alpha-blended, that each pixel would have its own alpha value, and alpha is inherently a 
transparency value. 

As to claim 27, applicant is trying to claim equation that fundamentally underlies 
alpha blending. The following blend operation takes place for each color channel. That 
equation is as follows (see McReynolds page 112, section 10.2, alpha blending, as one 
of an infinite number of examples of this equation): 

Coul ~ Csrc * Asrc + (1 — Asrc) * Crfst 

Where Cout is the output color to the framer buffer, Asrc is the alpha value, Cdst is the 
destination color, and Csrc is the source color, where source color is the color of the 
overall scene and the destination color is the color of the object to be added or 
composited with the overall scene or present image. 

The following equivalencies exist between the variables of the equation of 
applicant and the variables stated in the alpha blending equation from McReynolds: 
Ak+1 is equivalent to Cout, alpha is equivalent to Asrc, Xk is equivalent to Csrc, and Ak is 
equivalent to Cdst. (AK+i=Cout, alpha=Asrc, XK=C8rc, AK=Cdst). Now, applicant's equation 
will be factored and rearranged as below: 

^a:+i = ^¥ha * (A^j^. - .4^ ) + => Af.^^ = alpha *X^+ {-alpha -^\)* => 

^, = alpha * + (1 - alpha) * 
Compare to alpha blending equation as above: = C^*A^+(\- A^)*Cj^ 
They are exactly the same once the mappings specified above are performed. 
Therefore, since the Cesana reference teaches alpha blending, it inherently teaches this 
limitation. 
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As to claims 28 and 29, since as applicant has pointed out in the Remarks on 
page 2, alpha is always a positive value, less than or equal to one (inclusive of zero), 
Cesana inherently teaches this limitation. 

Claim 29 is a duplicate of claim 28 and rejected accordingly. 

Claims 30 and 32 are rejected under 35 U.S.C. 103(a) as unpatentable over 
Morein, Haeberii, and Cesana as applied to claims 7 and 17, and further in view of 
Adier. (Claims are method and apparatus, identical limitations, thus properly rejected 
as above). 

Morein, Haeberii, and Cesana do not teach that the 2D images are slices of a 
three-dimensional object. 

Specifically, AdIer teaches in Figure 2 that a stack of 2D slices from a CT scan 
(which is known in the art to be generated by incrementally moving a patient through a 
fixed scanning apparatus to generate a stack of sequential two-dimensional images of a 
3D object) can be merged to generate a three-dimensional model of said object. Adler 
further marks contours on each object (as is apparent in Figure 2)(4:35-55, for example) 
so that a composite view of the three-dimensional object can be generated and 
navigated around in three-dimensional space (6:10-16). 

Obviously, the system of Morein could be used to generate the resultant three- 
dimensional view, since Adler does not specify that much of the specific graphics 
subsystem used to calculate such details. 
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It would be obvious to one of ordinary skill in the art at the time the invention was 
made to combine the systems of Morein, Haeberii, and Cesana with the system of Adier 
so that a system that could more rapidly render three-dimensional models of bone 
deformation for scoliosis and the like could be generated and efficiently navigated 
through by a user. 

As to claims 31 and 33, applicant is trying to claim equation that fundamentally 
underlies alpha blending. The following blend operation takes place for each color 
channel. That equation is as follows (see McReynolds page 112, section 10.2, alpha 
blending, as one of an infinite number of examples of this equation): 

Cout ~ Csrc * Asre (1 ~ Asrc) * Cctei 

Where Cout is the output color to the framer buffer, Asrc is the alpha value, Cdst is the 
destination color, and Csrc is the source color, where source color is the color of the 
overall scene and the destination color is the color of the object to be added or 
composited with the overall scene or present image. 

The following equivalencies exist between the variables of the equation of 
applicant and the variables stated in the alpha blending equation from McReynolds: 
Ak+1 is equivalent to Cout, alpha is equivalent to Asrc, Xk is equivalent to Csrc, and Ak is 
equivalent to Cdst- (AK+i=Cout, alpha=Asrc, XK=Csrc, AK=Cdst). Now, applicant's equation 
will be factored and rearranged as below: 

y^jj.^, = alpha * (X^ -A^) + A^=> .4^^, = alpha *Xj^+ (-alpha + V)*A^ => 
"^ic+i = olpha * A'jf + (1 - alpha) * A^, 

Compare to alpha blending equation as above: C^, = * + (1 - .4^) * 
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They are exactly the same once the mappings specified above are performed. 
Therefore, since the Cesana reference teaches alpha blending, it inherently teaches this 
limitation. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 

CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed vk^ithin 
TWO MONTHS of the mailing date of this final action and the advisory action Is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action Is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any Inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eric V. Woods whose telephone number is 671-272- 
7775. The examiner can normally be reached on M-F 7:30-4:30 alternate Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on 571-272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Eric Woods 1 5 September 2005 




